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Section 6 

0-1 Laws. Convergence of random 
series. 



Consider a sequence (Xi)i>i of real valued independent random variables and let CT((Xj)j>i) be a a-algebra 
of events generated by this sequence, i.e. {{Xi)i>i e B} for B in the cylindrical cr-algebra on M'*'. 

Definition. An event A e cr((Xi)i>i) is called a tail event if A e CT((Xj)i>„) for all n > 1. 

For example, if Ai € cr(Xj) then 

Ai i.o. = Pi (J 

n>l i>n 

is a tail event. It turns out that such events have probability or 1. 

Theorem 9 (Kolmogorov's 0-1 law) If A is a tail event then V{A) = or 1. 

Proof. For a finite subset F = C N, let us denote by Xp = {Xi^, . . . ,Xi^). A cr-algebra 

cr((Xi)i>i) is generated by algebra 

{Xp €B:F- finite C N,B e S(RI^I)}. 

By approximation lemma, wc can approximate any event A G (T((Xi)i>i) by events in this generating 
algebra. Therefore, for any e > there exists a set A' in this algebra such that F{AAA') < e and by 
definition A' G cr{Xi, for large enough n. This implies 

\¥{A) - ¥{A')\ < £, \¥{A) - ¥{AA')\ < e. 

Since A is a tail event, A G a((Xj)j>„+i) which means that A, A' are independent, i.e. ¥{AA') = ¥{A)¥{A'). 
We get 

¥{A) « ¥{AA') = ¥{A)¥{A') « ¥{A)¥{A) 
and letting e ^ proves that ¥{A) = ¥{A)'^. 

□ 

Examples. 

1. |X)i>i -^i ~~ converges I is a tail event, it has probability or 1. 

2. Consider series J2i>i ^i-^' on a complex plane, z G C. Its radius of convergence is 

r = liminf * . 

For any a; > 0, event {r < x} is, obviously, a tail event. This implies that r = const with probability 1. 

□ 
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The Savage-Hewitt 0-1 law. 

Next we will prove a stronger result under more restrictive assumption that the r.v.s Xi,i > 1 are 
not only independent but also identically distributed with the law /x. Without loss of generality, we can 
assume that each Xi is given by the identity Xi{x) = a; on its sample space /i). By Kolmogorov's 

consistency theorem the entire sequence (Xj)j>i can be defined on the sample space (M^,S°°,P) where B°° 
is the cylindrical cr-algebra and P is the measure guaranteed by the Caratheodory extension theorem. In our 
case Xi's arc i.i.d. and P = is called the infinite product measure. It will be convenient to use the notation 
(7((Xj)j>i) for the cylindrical a-algebra since similar notation can be used for the cylindrical cr-algebra on 
any subset of coordinates. 

Definition. An event A e cr((Xi)i>i) - is called exchangeable/symmetric if for all n > 1, 

(a^i, X2, ■ ■ ■ , Xn, . . .) G A =v' {Xn, X2, x^—i, a;i, ...) G A. 

In other words, the set A is symmetric under permutations of a finite number of coordinates. Note that 
any tail event is symmetric. 

Theorem 10 (Savage-Hewitt 0-1 law) If A is symmetric then F{A) = or 1. 
Proof. Given a sequence x = {xi, X2, ■ ■ ■) let us define an operator 

T^X = • . . , X2ni -^l? * • * ? *^2n+l) * • •) 

that switches the first n coordinates with the second n coordinates. Since A is symmetric, 

TA={Tx:xgA} = a. 

By the Approximation Lemma 2 for any £ > for large enough n, there exists An G cr{Xi, X„) such that 
P{AnAA) < e. Clearly, 

Bn = TAn e a{Xn+l, ...,X2n) 

and 

P(S„AA) = F{TAnATA) = ''^' P(yl„AA) < e, 
which implies that P((A„B„)AA) < 2e. Therefore, we can conclude that 

P(^) « P(AO, » P(A„S„) = P(A„)P(S„) = F{Anf 

where we used the fact that the events A„, iJ„ are defined in terms of different sets of coordinates and, thus, 
are independent. Letting e — > implies that F{A) = P(A)^. 

□ 

Example. Let Sn = Xi -\- . . . -\- Xn and let 

1. Sn Ojn 

r = lim sup — . 

n — »oo '^n 

Event {r < x} is symmetric since changing the order of any finite set of coordinates does not affect Sn for 
large enough n. As a result, P(r < = or 1, which implies that r = const with probability 1. 

□ 

Random series. We already saw above that, by Kolmogorov's 0-1 law, the series J2i>i-^i inde- 
pendent {Xi)i>i converges with probability or 1. This means that either Sn = Xi -\- . . . -\- Xn converges to 
its limit S with probability one, or with probability one it does not converge. Two section back, before the 
proof of the strong law of large numbers, we saw the example of a sequence which with probability one does 
not converge yet converges to in probability. In case when with probability one 5„ does not converge, is 
it still possible that it converges to some random variable in probability? The answer is no because we will 
now prove that for random series convergence in probability implies a.s. convergence. 
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Theorem 11 (Kolmogorov's inequality) Suppose that {Xi)i>i are independent and Sn = Xi + . . . + X„. // 

for all j < n, 

mSn- Sj\>a) <p<l (6.0.1) 

then for x > a, 

f( max > a;) < P(|5„| >x-a). 

\l<j<n ■' J \ - p 

Proof. First of all, let us notice that this inequality is obvious without the maximum because (6.0.1) is 
equivalent to 1 — p < Pd^n — 5*^ | < a) and we can write 

(l-p)P(|5j| >x) < P(|5„-S'j| <a)P(|S',| >a;) 

= P(|5„ ~ S,\ < a, \Sj\ >x)< V{\Sn\ >x-a). 

The equality is true because events {\Sj\ > x} and {\Sn—Sj\ < a} are independent since the first depends only 
on Xi, ...,Xj and the second only on Xj^i, The last inequality is true simply by triangle inequality. 

To deal with the maximum, instead of looking at an arbitrary partial sum Sj we will look at the first partial 
sum that crosses level x. We define that first time by r = min{j < n : \Sj\ > x} and let r = n + 1 if all 
\Sj\ < X. Notice that event {r = j} also depends only on Xi, Xj so we can again write 

(l-p)P(r = j) < P{\Sn~Sj\<a)P{T = j) 

= V{\S^a-Sj\<a,T = j) <Vi\S„\>x-a,T = j). 

The last inequality is again true by triangle inequality because when t = j we have IS'jl > a; and 

\^\Sn-Sj\ <a,r = i} C J^\S„\ >x-a,T = jy 

It remains to add up over j < n to get 

(l-p)P(r <n) <P(|S'„| > x-a,T<n) < P(|S'„| > x - a) 
and notice that r < n is equivalent to maxj<„ \ Sj\ > x. 

□ 

Theorem 12 (Kolmogorov) If the series X^j>i Xi converges in probability then it converges almost surely. 

Proof. Suppose that partial sums 5„ converge to some r.v. S in probability, i.e. for any £ > 0, for large 
enough n > no(e) we have f{\Sn — S\ > s) < s. If k > j > n > no(e) then 

^\Sk -Sj\> 2e) < F{\Sk -S\>e)+ F{\Sj -S\>e)< 2e. 

Next, we use Kolmogorov's inequality for x = and a = 2e (we let partial sums start at n): 

Pf max \Si - Sn\ > 4e) < ^^n\Sk - ^nl > 2e) < < 3s, 

\n<j<k / L — 2e 1 — 2S 

for small e. The events {max„<j<fc \Sj — S„| > 4e} are increasing as t oo and by continuity of measure 

Pfmax \Sj - Sn\ > 4:e) < 3e. 
Finally, since PdS'n — 51 >e) < s we get 

P^maxIS'j - > 5e) < As. 
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This kind of "maximal" statement about any sequence Sj is actually equivalent to its a.s. convergence. To 
see this take s = -K, take n(m) = no(e) and consider an event 



I max |5,-S|> A|. 



We proved that 

and by the Borel-Cantelli lemma, V{Am i-o.) = 0. This means that with probability 1 for large enough 
(random) m, 

5 

max IS',- — 51 < — ^ 

j>n(m) 

and, therefore, 5„ — * 5 a.s. 

□ 

Let us give one easy-to-check criterion for convergence of random series, which is called Kolmogorov's 

strong law of large numbers. 

Theorem 13 // (Xj)j>i is a sequence of independent random variables such that 

EXi = and ^EXf < oo 

then J2i>i-^i converges a.s. 

Proof. It is enough to prove convergence in probability. Let us first show the existence of a limit of partial 
sums Sn over some subsequence. For m < n, 



n\Sn-Sm\>s)<\E{Sr,-Srr,f = \ ^ EX, 



2 m— »oo Q 



m<^<n 



If we take s = ^ then for large enough m{l) and for any n > m{l), 



1 \ 1 



P J - 

W.l.o.g. we can assume that m{l + 1) > m{l) so that 



Then, 



Sn-Smil)\>J^ <J^. (6.0.2) 



( |.Sr„(;+i) - 5'„(i)| > 4 ) < X] ^ 

1>1 ^ '■ ^ 1>1 '■ 



and by Borel-Cantelli lemma 

^ (\Sm{l+l) - Sm{l)\ > ^ i.o) =0. 

As a result, for large enough (random) I and ior k > I, 

1 1 



\S, 



This means that {Sm{i))i>i is a Cauchy sequence and there exists the limit S = limS'^((). (6.0.2) implies 
that Sn ^ S in probability. 

□ 
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ExEimple. Consider random series X^i>i ji where P(ei = ±1) = 5. We have 



SO the series converges a.s. for such a. 
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